Skip to main content

Focused Crawls

Internet Archive

Focused crawls are collections of frequently-updated webcrawl data from narrow (as opposed to broad or wide) web crawls, often focused on a single domain or subdomain.



rss RSS

694,400
RESULTS


Show sorted alphabetically

Show sorted alphabetically

SHOW DETAILS
up-solid down-solid
eye
Title
Date Archived
Creator
Top Domains
collection
348,228
ITEMS
3.3B
VIEWS
collection

eye 3.3B

A daily collection of thousands of the most popular web sites according to Alexa.com's top sites rankings .
Topics: daily, popular sites, Alexa
Top News
collection
243,292
ITEMS
1.4B
VIEWS
collection

eye 1.4B

A daily collection of hundreds of the world's top news sites.
Topics: daily, news
top_domains-00300
top_domains-00300
collection
9,431
ITEMS
90M
VIEWS
by Internet Archive
collection

eye 90M

top_domains-00600
top_domains-00600
collection
10,351
ITEMS
91.5M
VIEWS
by Internet Archive
collection

eye 91.5M

top_domains-00500
top_domains-00500
collection
18,442
ITEMS
109.4M
VIEWS
by Internet Archive
collection

eye 109.4M

top_domains-00900
top_domains-00900
collection
5,485
ITEMS
97M
VIEWS
by Internet Archive
collection

eye 97M

top_domains-02500
top_domains-02500
collection
5,197
ITEMS
62.1M
VIEWS
by Internet Archive
collection

eye 62.1M

edgi monitor
edgi monitor
collection
19,909
ITEMS
43.3M
VIEWS
collection

eye 43.3M

top_domains-00800
top_domains-00800
collection
14,935
ITEMS
73.7M
VIEWS
by Internet Archive
collection

eye 73.7M

top_domains-03500
top_domains-03500
collection
2,597
ITEMS
36.2M
VIEWS
by Internet Archive
collection

eye 36.2M

nytimes.com
nytimes.com
collection
2,942
ITEMS
49.6M
VIEWS
by http://nytimes.com
collection

eye 49.6M

top_domains-00400
top_domains-00400
collection
4,266
ITEMS
58.5M
VIEWS
by Internet Archive
collection

eye 58.5M

top_domains-00350
top_domains-00350
collection
3,339
ITEMS
72.1M
VIEWS
by Internet Archive
collection

eye 72.1M

top_domains-01500
top_domains-01500
collection
4,134
ITEMS
68.7M
VIEWS
by Internet Archive
collection

eye 68.7M

yahoo.com
yahoo.com
collection
2,622
ITEMS
58.4M
VIEWS
collection

eye 58.4M

top_domains-00250
top_domains-00250
collection
2,652
ITEMS
75.8M
VIEWS
by Internet Archive
collection

eye 75.8M

nbcnews.com
nbcnews.com
collection
1,831
ITEMS
46.3M
VIEWS
by nbcnews.com
collection

eye 46.3M

top_domains-00450
top_domains-00450
collection
3,864
ITEMS
58.4M
VIEWS
by Internet Archive
collection

eye 58.4M

top_domains-02000
top_domains-02000
collection
5,060
ITEMS
53.3M
VIEWS
by Internet Archive
collection

eye 53.3M

buzzfeed.com
buzzfeed.com
collection
4,120
ITEMS
39.6M
VIEWS
by buzzfeed.com
collection

eye 39.6M

top_domains-03000
top_domains-03000
collection
2,820
ITEMS
43M
VIEWS
by Internet Archive
collection

eye 43M

top_domains-07500
top_domains-07500
collection
3,504
ITEMS
52.9M
VIEWS
by Internet Archive
collection

eye 52.9M

top_domains-00700
top_domains-00700
collection
1,974
ITEMS
59.7M
VIEWS
by Internet Archive
collection

eye 59.7M

top_domains-02750
top_domains-02750
collection
3,198
ITEMS
54.8M
VIEWS
by Internet Archive
collection

eye 54.8M

welt.de
welt.de
collection
3,452
ITEMS
30.9M
VIEWS
by http://welt.de/
collection

eye 30.9M

foxnews.com
foxnews.com
collection
2,202
ITEMS
34.4M
VIEWS
by http://foxnews.com
collection

eye 34.4M

taringa.net
taringa.net
collection
1,380
ITEMS
39.5M
VIEWS
by taringa.net
collection

eye 39.5M

top_domains-08000
top_domains-08000
collection
2,429
ITEMS
42.1M
VIEWS
by Internet Archive
collection

eye 42.1M

msnbc.msn.com
msnbc.msn.com
collection
14,701
ITEMS
26.9M
VIEWS
by http://msnbc.msn.com/
collection

eye 26.9M

top_domains-09000
top_domains-09000
collection
3,874
ITEMS
37.4M
VIEWS
by Internet Archive
collection

eye 37.4M

top_domains-06000
top_domains-06000
collection
4,835
ITEMS
39.7M
VIEWS
by Internet Archive
collection

eye 39.7M

top_domains-09500
top_domains-09500
collection
4,887
ITEMS
44.4M
VIEWS
by Internet Archive
collection

eye 44.4M

top_domains-04500
top_domains-04500
collection
3,555
ITEMS
42.4M
VIEWS
by Internet Archive
collection

eye 42.4M

top_domains-04250
top_domains-04250
collection
3,235
ITEMS
40.1M
VIEWS
by Internet Archive
collection

eye 40.1M

top_domains-01000
top_domains-01000
collection
5,363
ITEMS
44.7M
VIEWS
by Internet Archive
collection

eye 44.7M

worldpress.org
worldpress.org
collection
668
ITEMS
50.8M
VIEWS
by http://worldpress.org/
collection

eye 50.8M

top_domains-04000
top_domains-04000
collection
3,598
ITEMS
41.8M
VIEWS
by Internet Archive
collection

eye 41.8M

top_domains-08750
top_domains-08750
collection
3,278
ITEMS
39.8M
VIEWS
by Internet Archive
collection

eye 39.8M

abcnews.go.com
abcnews.go.com
collection
2,715
ITEMS
21.8M
VIEWS
by http://abcnews.go.com/
collection

eye 21.8M

top_domains-04750
top_domains-04750
collection
3,229
ITEMS
34.1M
VIEWS
by Internet Archive
collection

eye 34.1M

top_domains-03750
top_domains-03750
collection
2,556
ITEMS
34.1M
VIEWS
by Internet Archive
collection

eye 34.1M

top_domains-02250
top_domains-02250
collection
3,419
ITEMS
51.7M
VIEWS
by Internet Archive
collection

eye 51.7M

top_domains-03250
top_domains-03250
collection
1,831
ITEMS
32.6M
VIEWS
by Internet Archive
collection

eye 32.6M

time.com
time.com
collection
894
ITEMS
39.1M
VIEWS
by http://time.com
collection

eye 39.1M

top_domains-05250
top_domains-05250
collection
5,986
ITEMS
34.2M
VIEWS
by Internet Archive
collection

eye 34.2M

top_domains-01250
top_domains-01250
collection
2,181
ITEMS
31.3M
VIEWS
by Internet Archive
collection

eye 31.3M

top_domains-05500
top_domains-05500
collection
8,127
ITEMS
34.1M
VIEWS
by Internet Archive
collection

eye 34.1M

top_domains-05750
top_domains-05750
collection
1,918
ITEMS
28.4M
VIEWS
by Internet Archive
collection

eye 28.4M

top_domains-06250
top_domains-06250
collection
2,508
ITEMS
34.2M
VIEWS
by Internet Archive
collection

eye 34.2M

top_domains-08250
top_domains-08250
collection
4,114
ITEMS
30.6M
VIEWS
by Internet Archive
collection

eye 30.6M

top_domains-01750
top_domains-01750
collection
1,710
ITEMS
35.5M
VIEWS
by Internet Archive
collection

eye 35.5M

top_domains-06750
top_domains-06750
collection
3,632
ITEMS
34.4M
VIEWS
by Internet Archive
collection

eye 34.4M

sfgate.com
sfgate.com
collection
3,634
ITEMS
27.8M
VIEWS
by http://sfgate.com
collection

eye 27.8M

top_domains-07750
top_domains-07750
collection
1,713
ITEMS
41.4M
VIEWS
by Internet Archive
collection

eye 41.4M

themeforest.net
themeforest.net
collection
744
ITEMS
37.6M
VIEWS
by themeforest.net
collection

eye 37.6M

blogspot.in
blogspot.in
collection
1,246
ITEMS
22.2M
VIEWS
by blogspot.in
collection

eye 22.2M

weather.com
weather.com
collection
1,329
ITEMS
19M
VIEWS
by http://weather.com/
collection

eye 19M

theweek.com
theweek.com
collection
1,892
ITEMS
13M
VIEWS
by http://theweek.com
collection

eye 13M

top_domains-06500
top_domains-06500
collection
3,070
ITEMS
30.8M
VIEWS
by Internet Archive
collection

eye 30.8M

huffingtonpost.com
huffingtonpost.com
collection
12,442
ITEMS
33.1M
VIEWS
by http://huffingtonpost.com
collection

eye 33.1M

top_domains-05000
top_domains-05000
collection
1,486
ITEMS
25.1M
VIEWS
by Internet Archive
collection

eye 25.1M

latimes.com
latimes.com
collection
1,063
ITEMS
26.4M
VIEWS
by http://latimes.com
collection

eye 26.4M

top_domains-07250
top_domains-07250
collection
2,648
ITEMS
23.8M
VIEWS
by Internet Archive
collection

eye 23.8M

fbdailycrawl.io
fbdailycrawl.io
collection
9,456
ITEMS
8.8M
VIEWS
by Internet Archive
collection

eye 8.8M

indiatimes.com
indiatimes.com
collection
1,100
ITEMS
13.6M
VIEWS
by http://indiatimes.com
collection

eye 13.6M

top_domains-07000
top_domains-07000
collection
2,663
ITEMS
31.1M
VIEWS
by Internet Archive
collection

eye 31.1M

top_domains-08500
top_domains-08500
collection
1,611
ITEMS
24.4M
VIEWS
by Internet Archive
collection

eye 24.4M

haaretz.com
haaretz.com
collection
1,420
ITEMS
12.5M
VIEWS
by http://haaretz.com/
collection

eye 12.5M

inn.co.il
inn.co.il
collection
3,307
ITEMS
24.6M
VIEWS
by http://inn.co.il/
collection

eye 24.6M

washingtonpost.com
washingtonpost.com
collection
1,250
ITEMS
20.1M
VIEWS
by http://washingtonpost.com/
collection

eye 20.1M

bbc.co.uk
bbc.co.uk
collection
1,039
ITEMS
19.6M
VIEWS
by http://bbc.co.uk
collection

eye 19.6M

chicagotribune.com
chicagotribune.com
collection
617
ITEMS
23.2M
VIEWS
by http://chicagotribune.com/
collection

eye 23.2M

wordpress.org
wordpress.org
collection
2,287
ITEMS
22.7M
VIEWS
by http://wordpress.org
collection

eye 22.7M

top_domains-09250
top_domains-09250
collection
2,566
ITEMS
23.6M
VIEWS
by Internet Archive
collection

eye 23.6M

liveinternet.ru
liveinternet.ru
collection
1,408
ITEMS
19M
VIEWS
by liveinternet.ru
collection

eye 19M